HI Seasickbumblebee,
you said: "Now he thinks we'll start our marriage on a rocky basis."
Immediately my thought was, he wants to back out of the engagement.
He sounds just from that, like a guy who will blame you for "letting" him engage in "sinful" premarital activity that causes his guilt.
It is much less painful to change your mind before the wedding, though it may not seem like it now. Also, that kind of stuff is a HUGE red flag.
Don't ignore it.